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A method of processing digital image infomiation. including pixel intensity 
information, includes the steps of identifying a region of the image in which pixel 
intensities are similar to each other, but the median pixel intensity differs 
significantly from the median pixel Intensity of other parts of the image; and 
modifying pixel intensities in the identified region so that the median for the region 
is closer to the median for the other parts of the Imqge. 

A related method of processing digital image Information involves 
modifying pixel Intensities according to a non-linear algorithm, with the result that 
one or more regions of the image have their median pixel intensities adjusted to a 
level which is closer to the median pixel intensity for other parts of the image. 

A composite digital image can be formed by obtaining first and second 
digital images of the same scene but with different exposure or light reception 
conditions so that one of the digital Images has higher pixel Intensity values than 
the other; identifying one or more regions on the first Image which are less clear 
than the corresponding regions on the second image; and replacing the identified 
regions of the first image with the corresponding regions of the second image. 
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Digital Image Processing 
This application is related to applications filed at the same time by the 
same applicant entitled -Imaging Apparatus" (claiming priority from Australian 
Provisional Application P05257 filed 24 Februa^ 1997) and "Vehicle Imaging 
> and Verification- (claiming priority from Australian Provisional Application P05256 
filed 24 Febnian, 1997).The contents of those applications are hereby 
incorporated lierein by reference. 

This invention relates to a method of processing digital image information 
It relates particularly but not exclusively to a method of selectively modifying pixel 

' .ntensity infom,ation in order to improve legibility or visibility of parts of a digital 

image. 

image contrast problems resulting in underexposure and over-exposure of 
parts Of an image are relatively common in photography. When an image of a 
person or object is ta.en facing into the sun, or with some other background 
wh,ch ,s bnght compared to the person or object, the person's or object s features 
Often are dimcul. to discern in the finished photographic image. Similarly, v,hen 
par. Of the ,mage is veo, bright compared to the rest of the image, the bright part 
■s onen over-exposed or "burnt out", so that its details are no. discernible in the 
finished photographic image. 

This problem is par.icularly noticeable in consumer video cameras which 
have automatic light contrast controls based on average light intensity for an 
■rnage. In order for such video cameras to be able to capture images with a range 

c pt'u^r '""T" '"^^ "^'^^ '"^ 0' -h image 

captured. depend,ng on the average brightness of all pixels in the image When 

an , mage ,s being taken, for example, of a person in an unlit room againsu 

b c^g und of a Window, wi.h bHgh. sunshine outside, the person will often ' 

Zoe " ' '"""""^ "'^'^ camera has 

compensated for the bright background by reducing the pixel image intensity. If 

he person moves against a wall in the same room, so that the window is no 

longer ,n the background, the average pixel intensity reduces, and the laml 

ompensates by increasing pixel intensities, so the. .he person's features bed 



m some video cameras, a manual image inlensily override control is 
provided .0 allow an operator ,0 compensate for this problem. The operator can 
move the control to ensure that the image pixel intensities remain bright even 
When the background is bright. This results in "image burn" (or over-exposure) for 
5 the background, but at least it ensures that the details of interest, such as the 
person s face, remain clearly visible. Alternatively, if the operator fs taking images 
Of, say. a „,eworks display on a dark night, the camera v^ill naturally tend to 
bnghten the pixel intensities to compensate for the darkness of the average pixel 
.ntensay. with the result that the fireworks images are -burnt out". By using the 
manual exposure control, the operator can ensure that the pixel intensities remain 
aark and the fireworks remain visible. 

in film-based photography, it is possible to compensate for a bright 
background or a dark background by varying the length of exposure during 
development of the film. However, if it is desired that very dark and very brigm 
s features both be visible in a photograph, i, is o«en necessary to use two different 
exposures and create two separate images. 

A particular application in which image contrast presents a problem is 
t affl cameras used in Law Enforcement Programs such as speed and red-light 
v,o t,on prosecution. Due to the retro-refiective nature of most licence plates any 
ht energy Which is directed towards this area is reflected back at a level (resu, 
Of a h,gH reflection efficiency, which is higher then the average intensity entering 

la onr; ^^^°--> ^PP-- -ound the 

area of the licence plate. An example of this is shown in Figure 14. 

Summary of the Invention 

varvinoThe'""'"' ~ '° ' °' ~ely 

varying the image intensity of part of an image. 

According ,0 a first aspect of the present invention there is provided a 
method Of processing digital image infom,ation which includes p J, inTe„2 
information, including the steps of: ^ 

each IrtTth " ""''^ '"'^"^"^ - ^War .0 

pTe int . K ""'""^ ''"^^ -edi- 

pixel intensity of other parts of the Image; and 
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modifying pixel intensities in the identified region so that the median for the 
region is closer to the median for the other parts of the image. 

The identified region of the image may have a median pixel intensity below 
the median pixel intensity of the rest of the image, as in the previously described 
example of a person photographed in a dark room against the background of a 
bright window. The region may comprise the person's face, and the pixels in the 
region of the person's face may be modified by increasing their intensity values 
until their median intensity value approaches the median for the rest of the image. 
This results in an image which shows both the background and the person in 
good detail. 

Alternatively, the identified region may have a median pixel intensity higher 
than the median for the rest of the image, as in the previously described example 
of the retro-reflective licence plate. In this case, the identified region is the licence 
plate, and the pixel intensities in that region are modified by reducing their 
intensity values until their median intensity value approaches the median for the 
rest of the image. Again, this results in an image which shows both the 
background and the licence plate in good detail. 

The region may be identified in any suitable way. One way of identifying 
the region is for a person to examine the image and manually identify any region 
which needs pixel intensity correction. Another way is locate computationally any 
pixels which have an intensity greater than a particular high value or less than a 
particular low value and which have more than a predetermined number of other 
pixels meeting the same criteria within a predetermined distance. Another way 
arises when all images being processed have common features - in this case, a 
predefined region at the same place on each image can be used, if it is known in 
advance that the region contains pixels which require pixel intensity correction. 
Alternatively, if it is known that a similar-shaped region requiring pixel intensity 
correction will appear on all images, but not necessarily in the same place (as in 
the case of traffic images featuring retro-reflective licence plates), a shape 
recognition algorithm may be applied to the image to locate the region. 

Any suitable pixel intensity modification algorithm may be applied to the 
identified region. One suitable modification algorithm involves adding a fixed 
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intensity value to, or subtracting a fixed intensity value from, all pixel intensity 
values in the identified region. Another algorithm involves multiplying or dividing 
all pixel intensity values in the region by a fixed amount. It will be appreciated that 
many different algorithms using fixed or sliding scales may be used, depending 
upon the particular application. 

According to a second aspect of the invention, there is provided a method 
of processing digital image information by modifying pixel intensities according to 
a non-linear algorithm, with the result that one or more regions of the image have 
their median pixel intensities adjusted to a level which is closer to the median 
pixel intensity for other parts of the image. 

In this aspect of the invention, the pixel modification algorithm can be 
applied to the whole of the image, and not just to a particular identified region. For 
example, the algorithm may specify that ail pixel intensity values over a particular 
threshold are to be reduced according to a particular scale, and all values under 
the threshold are to be kept constant, or increased or reduced according to 
another scale. In the case of the previously described example of a person 
photographed in a dark room against the background of a bright window, this type 
of algorithm may be successful in selectively increasing pixel intensities in the 
face region relative to pixel intensities elsewhere. On the other hand, the results 
may be less than desirable if other parts of the image which do not require 
intensification have pixel intensities similar to those of the face region. 

In the previously described example of the retro-reflective licence plate, a 
non-linear algorithm applied to all pixel intensities may be successful in reducing 
"plate bum", by selectively decreasing all pixel intensities over a particular 
threshold relative to pixel intensities elsewhere. 

When processing digital images according to the first and second aspects 
of the invention, the input device (such as a scanner or a digital camera) needs to 
have a sufficient "dynamic range" to resolve all the light intensities under 
consideration. The dynamic range of a CCD imaging system is the ratio of CCD 
saturation (full well charge) to the read noise. It is the ability to detect 
quantitatively very dim and very bright light infomiation in a single pixel. For 
example, if a CCD has a typical full well of 45.000 electrons and 1 1 electrons read 



noise, then Ihe dynamic range is 45 onn / i , . 

12 ri^nrriro,:;:?;? ^-"^ '° ~ '-^^ 

CCD. However, .his produces 3 .al T " ''^ 

ieveis. Which . ,he caTo a ^3 °^^^^^^^^ 7' "» '^^'^ s 

= 6.9 X 10"" bits of RGB i„r . '° ""^^ X "OSS X 4096 

Of -he hu.a„ tr r '"^ 

■0 9'ey levels or inLsifel ' '""^^ - ^' -s, U8 

«orn,a,ion produced hy cCD 2 T '"^^ ^-"""'^ °' 

'nvenlion is primarily directed toward ererir""' ""'^^ 
" Pixel intensity range which provide .k "'^"^"""^ °' 

s«e effect is that his re u Its nTv ^ 
Which must he stored. " '=°""'-^'°" °' of data 

One, suitable algorithm for achievino lhi= ,„ „ 
broad band of intensity levels in the r T ' '^'^''-'^ 

» narrow band of pi«. ils^ vies ^^^^ "^^^ '° '^^ 
P'a.o -burnt ouf pi,e. valL, ^ -1??"°" 

comparat^eiy narrow band Of intensity ievetTn the r , ^ 
rest of the image. In other words the par, If H '° '"^ 

has its Pixel intensity range exoandl r ^'-'"^'-n 
-ess than the compLoro ^ 7;°"""-- - -°"nt signi„can«y 
compressed. '™Se) and the rest of the image k 

For example, an 8-bit intensity pixel provides 256 d rr 
■ntensity or grey-scale levels. It may be desirable ^ """'"'^ 

.f "'"e-t possible intensri vej ' 

burnt out- licence plate may have ■ , ""3'"^' '™9«- »>e 

-el «0. A suitable result I wh c^ ZT '"'^^ "^^ '^^^ ^"o- 

by mapping the firs. 230 levels in ,h» "^'^^ 

™age to levels , to ,0 i„ ,he 



compressed image, and mapping levels above 230 in the origin ■ • 
1 1 to 1 6 in u,e compressed image. ^ 

^ a omposite d.g.tal image including the steps of 

■ ...ere:::::::: ,;: r : - - scene 

'0 replacing the identified reqions of tho r , • 

regions of the second image. corresponding 

The regions identified as less clear iho« 
second image may be -burn, our reg^o s T "''""^ °" 

or -blacKed our regions such as me deX, a ' """""^^ "'^'^ 

'5 brigm image. ^ P«^^°" = 'ace in an olhenvise 

-ge 2r::z:zz::rr °' - - 

P'xels in .ne „rs. image anl e^d ^a °' '"^ 

example. ,He pixels in Ihe flrs, image Ze 'T 
0 -n. our region all pixels Have ^ ^o'e::::::::""- 

version ,he corresponding pixels o, ,he -bum, ou," I k """" 
from 33 to 64. all pixels In the lir« ■ ^^"^ "^'"^^ »' 

be.veen 1 and 48 1 a ir """" '"'^"^"^ <" 

■«>. wim all intensity values between 33 anri c ■ 

-age being reassigned to values between 49 and L I r ' 

a combination of more than two images. ""^""""^ •» 

The first and second digital images may be „h>=- . ■ 
-anner. They may be obtained simultanlslv n '" ^""^"'^ 

a Single optical plane or path be u^ oT " " - P-'erred that 

used to ensure pixel relativity in each image, so 
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that pixels align correctly. One image may have a longer exposure time than the 
other. Additionally or alternatively, an optical filter may be applied to a digital 
camera in taking one of the images. 

In one preferred arrangement, a single objective lens is used to provide a 
common optical path for two CCDs. The image is split using a 50% reflective 
mirror with 50% of the light going to a first CCD and 50% going to a second CCD. 
The ratio can be adjusted to suit the application. Most CCDs have built-in 
electronic shutters which can control the exposure time of the imaging area. 

Configuring the first CCD to have a relatively slow shutter speed (say in the 
order of 1/250"' of a second) can provide sufficient image contrast for low and 
medium light levels (that is. energy levels normally expected back from the object 
of interest). The second CCD can be geared to record abnormally high light levels 
(resulting, for example, from in-line flash systems targetted directly at retro- 
reflective licence plates) with a shutter speed of around 1/1000'" of a second 
Running the shutter at this speed also reduces the effects of velocity blur caused 
by an object moving whilst the camera shutter is open (thus increasing licence 
plate readability). 

This configuration ensures that a sufficient dynamic range of data is 
available for the image combining/compression processes and ensures 
successful outcomes. It also allows for the use of cheaper lower dynamic range 
CCDs and associated electronics such as analog to digital converters. 

An electronic feedback mechanism such as automatic gain controls 
(AGCs) can be used to automatically adjust shutter speeds or output amplification 
to ensure nominal system outputs. 

According to a fourth aspect of the invention, there is provided a method of 
fomung a composite digital image including the steps of: 

Obtaining first and second digital images of the same scene but with 
different exposure or light reception conditions so that the first digital image has 
higher pixel intensity values than the second; 

identifying all pixels in the first image which have a pixel intensity greater 
than a predetermined value; and 



replacing ihs idenlined oixels in ih» r . • 
"om ,he second image. "^'"Ponding pixels 

The intensity values of pixels in tho r . 
-ip.a.ed .ero. o. d.ing :e tCg ^ T ""^^ " 

*«eren, intensity levels in each in,age and .H 7 ' ' " =™ 
■» image is 64. .here n,ay be a 117. , — -he firs. 

-a. value. The correspond """"" °' ""^'^ '^90 wi,h 

• Me corresponding pixe s in the <if^nr.r.rt ■ 

values ranging behveen 33 and 64 l„ 7 ™^ """^ 

'rom .he firs. i.age re.ain imensily vlest^ '^""^ ^'"^'^ 

'epiaced, each „, .he pixel inlen^- t ^t,' '"^ ^^^'^ ^re no, 

" -.-sily levels or be^vee ^d b p 

values of behveen 33 and 64 in (he se.„ ^ " °' '"^ 

.o 3., giving a range of fro! 4 .Ta Th" ' 
replaced pixels ren,air,ed brighler .han .hl n ^"'"'^ 
I. will ho non-replaced pixels 

" ''^ apprecialed .ha. Ihe IhinJ and f„„r,K 
» opera.e effecively when ,he CCDs oT .k °' 

relalively low dynamic range- .ha. is wh.nl "^""^^^ "^^^ ^ 

-ch can be de,ec.ed is La.iv I ^ Tad"""^' " '""""'^ '^^'^ 

*nfon„a.ion arises because a sL„ ' °' ""^'''"S »<e digilal 

However, .he overall «exibili.y avarbtUr""' " 

'"an for .he me,hods described in ,h ^, ! ' ' """"^ 

. w.« he apprecialed .ha. all f :ra::^^^^^^^^^^^^ ^^^'^ °' '"^ ~n. 

-age scanners, digiial cameras and any o he di^ ^''^"^^"^ '° 

This invenlion vW« hereinafter be descl^ 
.he anached drawings which show exa "r f '° 
undersfood ,ha. .he particulari^ of .ho» d " '° 

seneraliiyofhe preceding descrip.ionof«.ei'rr "°' ""''^^''^ 
Detailed Description 



Figure 1 is an illustration of a tvoical h»,H 
embodiment of the invention. ^'^ ^«°"''"9 '° an 

F.-9.re a SHOWS a compaHson between a 4-bit scaie an. an .bit 
' ^^^^ n..e 3 S.0.S an B-bit ima.e of a motor veHiCe incl..i„, a tioence plate 

Figure 4 is a s.,ph of pixel intensity values for , ■ . 
mage, ' "^'"^^ a typical speed violation 

Figure 5 is a diagram stiowing an alooriihm r 
'0 information to 4-bit infom^ation accoX 1 " ' '"'^"^"^ 

Figure 6 is a 4-bit version o, the !Zt ^ ' 
according to the algorithm of Figure 5. ' ^'^^ "^appmg done 

ccmpress'ralgolm. '""^'"""^ -°»'- Pixel intensity 

" Figure 8 is a further scliemall. ^ 

algorithn,. *^9^am illustrating the compression 

Figure 9 is a 4-bit version of ih 
according to the algorithm of Figures 7 andT^ "^"'^ ^' """"'"S """^ 
Figure 10 is a 4-bit version of the imaoe n, r 
» according to the direct division algortthm "^"^'"3 ''""^ 

Figure 1 1 is a schematic represeniaiir^n „, ... 
«on With the method o, t^e 

Figure 12 shows a representation of a is hT' 
• '"•^"'^ "" "^e in the camera of Figure 11 '"'"^ '° 

Figure 13 is a representation of a no„ ,• 

e..min..g.op,,3, bum- in accordance With the Ive!:: "'""'^ 

Figure 14 shows an image of a vehicle with , 
a twical case of "opUcal bum". ~^'-«xP°^ed licence plate. 

Figure IS shows a portion of the imaoe of r- 
accenting ,o the invention so ma, the licence ' h "'"""'"^ 
. Figure 1 shov« a typical Hardre' y: ^ ^ 
'"ventive meU,od. A light image is detected byTcha " ""^ '"^ 

o oy a charge coupled device (CCD) 1. 
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Which is an e>emen. of a ^pe which is used in video cameras. The detected 
10 analog ,o d,g„al converters (A/D converters) 2. The digital signals so produced 

^e-,e crtteria. Thl ^^^^^^^^^^ ^ n 

signals are then passed to a thirw nco . 

a.gori,h. . appJd. 1. a 1' ed t^nl cT r"^''- " 
anrf mnn. w « PPreciated thai this configuration is illustrative only 

iCr ' """"^ - '° — - -i- o, thi' 

hori JaltreaTco!^^. ^^""^ ^'^^ — ^ - 

p: >^ P-'—ve potential v^rs.C2^^^^^^ T ^ '"^'^ 

' ^ r , quantity of the charge co ected in each niy*>i 

a l,near function of the incident light and the exposure ,in,e Thus a 

between tho i.>,K# « pwj>uie ume. inus a convers on 

, Detween the l.ght energy and electrical charge is obtained 

After exposure the charge packets are transferred from tho • 
the serial register, typically at the rate of n r ""^^^ ^'^^ *° 

- depends on the partiTular CcTo T ''^^ 

serial register L . ^^^"^^--^ the 

register, the senal register gate can be clocked until all of th« k 

packets are moved out of the serial r.n.c ""^^'^^ 

ine serial register through a buffer anw ar«.,i r . 
stage producina a «inn^i . "uner and amplification 

a i^ioaucing a signal of approximately 50mV 

outputs correspondino ^^Pa'ate 
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outputs corresponding to each individual colour. 



30 



One suitable type of CCD image sensor is Sony's ICX075AK 

~ ~ ... ^ :Lrr :r:r :r 



M*0 C ^»TV»X3»OM«U3ll£E««ciSKW« 



s ever;::r ""^^ °' •^P- °' CCD has 

~ 

The time for outpuMing al, of the pixel signals is given as 1/25sec(40n,sec, 
Therefore, .he data rale for .he ICX075AK can be oa.oula.ed as- 

and pixel time Is calcufated as: 
1/data rates 82. 1nsec. 

(Note; the pixel time is actually les* du** m ^k, . 

Hnes and frames With CXD2424 t '"^"^ ''"^^^^ 

^ ^ nes. with CXD2424 timing generator it is 68nsec.) 

'n a preferred arrangement described in more detail in tho 
co-pending patent application entitled "Imaging ^1 . 
part Of the apparatus comprises an array o 121000 s ^'"'"^ 

a high resolution. One preferred eld^r L 

and another has a 5 x 5 arrav in fh« i « ^ 

«« o o array, in the atter case 25 nf fh** /^<^r> 

a sensors in each rc„ and a sensed::: 1, l^' C^O^ 
sensor ,s employed .o cap.ure .he whole image in low reso.u.ion ' 

-n.-end.;, wL h^i ' :z: T:r " '° ^^^-^^^^ 

AOC. and -P-anlhold/Tre ; 

ICX075AK is CXA1690Q. However LncJT l ' 

are also suiteble. ''""'"S Device's AD9807 



Which red:c:tr::ra:z:^^^^^^^^ ^ - -p-e- . 

a.e required. Hach r^.,:::^:^ Te^Z 7, ' 

sensor ou,po. .o «,a. row s A/D convers T^^e i T '^^ ^^^^ 

onvener 9. There is one 3x1 mulliplexer 8 for 
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each row of the sensor array. The main criteria for the multiplexer Is that its 
propagation delay should be low enough for 12.5mhz(80nsec) data rate. 

The next component shown In both Figure 1 and Figure 1 1 is the A/D 
converters 2. 9. which convert the analog electrical signal Into a digital signal. The 
resolution and dynamic range of the A/D converter stage - as well as speed - 
determine the required brightness resolution of the final digital image. The bit 
resolution required for >60000 levels is 16. but 16-bit converters are not presently 
commercially available. Possible sources for 10-20MSPS. 10-14blt A/D 
converters are: 

Sony: 10 bit - specifies CXD231 1AR (20MSPS) converter for ICX075AK 

Analog Devices; 10 bit and 12 bit 

Crystal: 10 bit and 12 bit 

Brooktree: 8 bit only 

Comlinear Corporation: 12 bit 

Datel: 10 bit, 12 bit and 14 bit 

Bit resolution of the available converters introduces a potential problem in 
capturing the image with the brightness resolution required for processing of the 
final image to resolve "optical bum". Possible solutions for this problem include: 

As shown in Figure 12. a 16 bit converter can be made out of a 12 bit 
converter 10 and a 4 bit converter 11. The disadvantages of this method include 
the number of components required, requirement for trimming of D/A voltage 
amplification of very low level (and high speed) signals, uncertainly about final 
performance and the development time. 

As shown in Figure 13. a non-linear amplifier 12 can be introduced 
preceding the A/D converter 13 such that the incremental voltage gain is kept at 
minimum at low brightness levels but Increased to a higher value at high 
brightness levels. Although that brings a problem of gain-matching among all five 
row amplifiers, this problem can easily be tolerated because there will be 
considerable improvement in resolution. 

After the A/D conversion stage. Figure 1 shows some digital signal 
processors (DSPs) 3. 4. 5. These are primarily Intended to provide data 
compression, and may be arranged in various different ways. As Indicated above 
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^"angemem of Figure 1. ,he firs, OSP 3 m 
<"« data Ms from a is-bi, signal. " "=--^-te<=.ab.e range 

CCD in!!?vTvi'i;; ii";:: j aTrr ~ 
' r : ^-Z i:: r^^^ " '"^ 

-gnais are fu„ colour signals in a differe„,7 

formals (.elevision ,or.a,s u el n 1 T'' °' ^ "^^^ "^^ "AL an. 
''.nal oo.pone„,s represenling I J : ^"^ .hree 
conversion provides , he firs, ,ev!l Of da '"-"inance. This 

'"e 'ac, ,ha, ,he hun-an eye InordW^"'""- '"^ ''''"'""^ on 
•n.ensi^. V«,h ,he Vuv forL. 1 a r" T ^ " 

represemed hy 4 in,ensi,y values. 2 blue Inl 1" - '''''' ' ^-"P - 

averaged over ,he 4 pi.el group' ' """'"^"^^ ^^'^^ ""--^ are 

values, v^hereas when represen ed by Ror f " '^"--'^^ « 
" -Parale red. green and blue a^es reo 

same amount of da,a. ' '^""'""3 a lolai of 12 values for ihe 

"The third DSP 5 ©f F* 
compression algori,hm such as HuILTZ"" '^"""^ "> a 

exis,. allowing differen, compress! ""'^-n 
- -P-sio„ .,10 diners depending o~^^^ -"ough , he ac.ua, 
'-"n^ue. ,he advanlage of using such ,Ic^ ' coding 

generally comain large areas of const, °" ™ages 

coding a,gori,hms. cons,s,ency which considerably benefi, L 

The da,a compressor s,aaa ia u 
' '^"^ "^^ -3" -ata .ransfer rat ,o an aT" " -aWy ,o 

'^'eved by ,oss,ess image compreTsirr'' ' - "a 

a.9ori,hms are -Huffman coding- r '"^ °' '"a Possible 

coding-. The inpu, da,a for ,his 

(5 X 3 6S4 120 by,es/frame) * 7,„ „, 

bytes/frame or 20 iviby,es*ame. "^^^'^ame = ,9 001 424 

On Ihe other hand, the data r=t. , 
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Therefore, it can be concluded that: 

for 2 frames/sec camera speed, no compression is required- 

require!; ' "-P-"- is 

' requirel" ' ^^P--- » 

requirJr ' """" ~-P--- - 

(note: however, anything less than 5 frames/sec will require slower pixel 
» <='«* or extra waiting states between scanlines.) s'ower p,xel 

The options for the data compressor include: 

ADSP2171 orADSP21csp01. 

One (or more if required) 32bit fast DSP. e.g. TMS320C80 of Texas 
Instrument or SHARC or Analog Devices. 

One (or more) Field Programmable Gale Array (FPGA) . 

The 1- and 2" options are more suitable for Huffman coding. The 3" 
opuon .s more suitable for predictive coding, especial^ for the simplest predictive 
codmg algorithm. DPCM. (Another advantage o, the 3" option is that it can 
incorporate PCI bus interface as well.) 

During .he data compression and digital signal processing stages the 
n,ens,.y values of pixels in one or more regions of the image arl ad 'usL fo 

■llustrated .n Figures 14 and 15. a region 15 (the front of a car) has been 
extracted an image which shows a car ie against a dar. baCgrLd M 
r^I. VI J t ' ' °' " '"'"^^ «-"ce plate 18 is 

Xs zz :™r" '° '~- - p- 

The final stage shown in Figure 11 is the PCI bus interface iq th 
PC. It recedes compressed data from the data compressor stage and arranges it 
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responses ,o send back. Depending upon ,he selected opHon for ,he da.I 
compressor, .here m be different buffering end/or n,u.,ip,exing between tha, 

!!ed? ! ' ' ^""-^ ^-P^-io" stage (it .a 

need an externa, fast SRAM for Huffman coding,. A.,en,ative,y. a DMA DireJ 
Memoo. Access) port of a DSP can be used. 

procesiT' a T '"^ '"^ -version 

.0 Tan "atiTn pr^ ' ^^"""^ This 

.uantizat on process converts the continuous-tone intensity, at the sample point 
to a digital brightness v^Iua tk^ ^ k ^ h^uu, 

dependent unnnV "'8"^' '^'"^ directly 

dependent upon how many bits are used in the quantizer. „ 3 bits are used the 

bnghtness can be converted to one o, eight grey leveis. .n .his case g^y evel 0- 

rep^sents btaC, grey ieve, T represen.s white, and grey ,e a, ■ - o -6- 

::rr - n m e gnt grey 

with a 4-bit brightness value, evan^ ni»er. 
one of 16 grey levels A 5 hi, h ■ k. * ' " '^P'«='^"'«'' "y 

An 8 hi, h 7 " ^ 32-level grey-scale range 

» le t r::::~ ^ -^-sca. rang. Eve. addi.ionall: 

brightness valtis Jdl r " " ""'^^ ^" '^^^^ ""-^ 

values IS sa,d to have an available dynamic range of 256 to 1 Fir,,,™ 

iVo whte"^ ::r':" ' °" ^-^^ 

lo wnite are more continuous in the 8-bit qrev seal*, th, • ,u 
scalp 51 TK« ... ^ ® ^2 the 4-bit qrev 

scale 21. The smoothness of the grey scale improves as mor. h , 

represent brightness. ""^^ "^^^ *° 

For the purpose of illustrating the inventive m^fh^w • 

compression operation, the following lmp,e~,o ™ """^ ^ 

Figure 3, being dynamically sampled to a 'triage and h ""T 
are compared against the original S-bit image. ,7. 3 sC;;:;: ''T 
-t.e. dar. background scene 23 w«h a vehlc.! . havlnTa ™ ' 
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Three methods of dynamic extraction have been tested for this example. 
Example 1: 10-levels and 6-IeveIs representation 

Typically, the brightest area of a speed and red-light violation image is in 
the licence plate area, the car head lamps or another white area. This means that 
these areas reflect most light energy, causing higher Intensity light to enter the 
camera. Figure 4 shows a typical histogram of the intensities of pixels in a speed 
violation image. 

This method assumes that the Licence Plate is always located at the high 
10-200/0 of the intensity graph 26. Pixel intensities for the remainder of the image 
27 are centred around a lower value. Therefore, to convert the 8-bit image (255 
levels of brightness) to a 4-bit (16 levels of brightness) image. 6 of the 16 levels in 
the final 4-bit image are assigned to the highest 10-20% intensities of the original 
8-b.t image (representing the Licence Plate) and the other 10 levels are assigned 
to the lowest 80-90o/o of intensities of the original image (representing the rest of 
the Scene). This method is described in the following pseudo code: 

Compute the highest intensity (Ymax) of the image. The lowest intensity is 
assumed to be zero. 

Calculate 10-20% high intensity range from the Ymax. 
Compute the magnitude of each division for Scene image (10 levels) - 
Scene_Dlv and Licence Plate Image (6 levels) - LP_Div. 
Convert each pixel of the image to intensity Y. 
For each pixel Y. 

if the intensity is in the "Scene" range, divide the intensity will, ,he 
Scene_Div . 

if the intensity is in the -Licence Rate" range, divide the intensity with the 

f. 



LP Div. 



resulting 4-bit image is converted back to an equivalent 8-bit image by multiplying 
each intensity value by the conversion factor (256/16). 

For example: If Ymax = 240. 

20% Intensity of the high end is 240 * .8 = 192 
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If a calculated Y intensity is 180 (in low intensity range), then the 
equivalent level is = 180 / Scene_Div 

If a calculated Y intensity is 230 (in high intensity range), then the 
equivalent level is = ((240 - 230) / LP_Div ) + 10 

Figure 5 illustrates the mapping arrangement used by the above example. 

The resulting 4-bit image of the above described method is shown in 
Figure 6, including a blown-up view 28 of the licence plate. 
Example 2: Bit-wise representation 

This option allows 4 Individual bits of the 8-bit image to be selected to 
represent the 4-bit image. Since the High Order Bits (Most Significant Bit) contain 
the most information. 3 out of the 4 High Order Bits are normally selected to 
represent a 4-bit image. One bit is selected from the Low Order Bits to maintain 
the contrast of the Scene. 

This is illustrated in Figure 7. Bits 1. 4. 5 and 6 are selected to represent 
the new 4-bit image. This could be accomplished by using a logical bit-mask AND 
method. The Bit-wise representation method is described in the following pseudo 
code: 

Convert each pixel of the image to intensity Y; 

For each Intensity, perfomi a logical AND operation with the pre- 
determined bit-mask and then perform the appropriate bit shifting operation. Eg. If 
bit 1, 4. 5 and 6 are to be selected to represent the 4-bit image, the bit-masks are 
00000010. 00010000. 00100000 and 01000000. Figure 8 illustrates the bit-mask 
logical AND and bit Shifting operations. 

For the purpose of displaying this 4-bit image in a graphics program, each 
pixel is converted back to an equivalent 8-bit representation by multiplying its 
intensity value by a conversion factor (256/16). 

Figure 9 is the result of the above described bit-wise representation. Bits 4. 
5, 6, 7 are selected to represent the 4-bit image. 
Example 3: Direct division 

This option is similar to the first option described above in which the 
Licence Plate and Scene are divided into two separate levels. The difference with 



M(«i cxvtswouniAMKmiMntaio>UMt9n ooc 



this option Is that each Licenc** Pi=t^ ^ ^ o 



to 



80% - Value__80. 

Calculate the conversion factor for Licence Pin»^ ^, 
and Scene (Ymax / Va,ue_80). (yrr^e^ma..Vafue_80) 

Convert each pixel of the image to intensity Y : 
For each intensity, 

if the ioleosNy is in the high intensity range (20% range) 

1. compute the magnitude of the intensity On,ens>fy. v.,ue BO) 

2. On,^e .he magnitude t,y , 6 - ( (MensUy - V.e,„e_8q, / ,6)" 

^ ...atrr ::::::r — °' - -e . ... 

If the intensity is in the low intensity range. 

1. Divide the intensity by 16 - ( intensity/ 16) 

2. Multiply the result with the conversion factor of th. 

(Ymax / Value^SO). " '^esw// x 

For the purpose of displaying the 4-bit image with a oraohi.. n 
resulting 4.bit image is converted back to an equivalen 8 ^ "^"7^°^^^"^' 
each intensity value by the conversion factor ~ 

Figure 10 shows the result of the DW^rf h:,,- • 

The foilovwng observations IZe ZTZry 
Hxperimen. 1 - ,o teveis and a ieve-sUrsen I: 

Scene : Becomes darker but visible 

Hxperi^ir :::r:;r .T '^""^ "'^ 

wise representation - bits 4, 5. 6. 7 (4 MSB)- 
S^ne : Becomes brtghter and similar to U,e original image 
Licence Plate : Brighter and veiy close ,o the original imaae 
Expenment 3 - Direct Division: ^ 

Scene : Visible and simnar to the original image. 
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Licence P,a.e : Poor- number is more diificu., ,o read. 



Conclusion: The method used in ExBerim«n. i ■ 
olhers because the Licence Plata 1 « Preferred above the 

original image. The SceTeTa 7" """^ '^^"^^'^ 

■he overa,, ima ' " " ' ^« «>^» "C .He critical part of 



-V bi' liter a'r T: - 

ambit Of the inventil """^ '•^P^'""^ 'rom the 
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The claims defining the invention are as follows: 

1. A method of processing digital image infomiation which includes pixel 
intensity infomiation, including the steps of: 

identifying a region of the image in which pixel intensities are similar to 
each other, but the median pixel intensity differs significantly from the median 
pixel intensity of other parts of the image; and 

modifying pixel intensities in the identified region so ttiat the median for the 
region is closer to the median for the other parts of the image. 

2. A method according to claim 1 wherein the identified region is identified by 
locating computationally any pixels which have an intensity greater than a 
particular high value or less than a particular low value and which have more than 
a predetennlned number of other pixels meeting the same criteria within a 
predetermined distance. 

3. A method according to claim 1 wherein a shape recognition algorithm is 
applied to the image to locate the region. 

4. A method of processing digital image information by modifying pixel 
intensities according to a non-linear algorithm, with the result that one or more 
regions of the image have their median pixel Intensities adjusted to a level which 
is closer to the median pixel intensity for other parts of the image. 

5. A method according to claim 4 wherein the non-linear algorithm involves 
reduction of pixel intensities which have intensity values higher than a 
predetermined threshold value and/or intensification of pixel intensities which 
have intensity values lower than a predetenmined threshold value. 

6. A method of forming a composite digital image including the steps of: 
obtaining first and second digital images of the same scene but with 

different exposure or light reception conditions so that one of the digital images 
has higher pixel intensity values than the other; 

identifying one or more regions on the first image which are less clear than 
the corresponding regions on the second image; and 

replacing the identified regions of the first image with the corresponding 
regions of the second image. 
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7. 



A method according to claim 6 wherein the pixel intensity values of the first 
and/or the second images are modified prior to or during the replacing step. 

8. A method according to claim 6 involving the combination of three or more 
images. 

9. A method of fom^ing a composite digital image including the steps of: 
obtaining first and second digital images of the same scene but with 

different exposure or light reception conditions so that the first digital image has 
higher pixel intensity values than the second; 

identifying all pixels in the first image which have a pixel intensity greater 
than a predetermined value; and 

replacing the identified pixels in the first image with con-esponding pixels 
from the second image. 

1 0. A method according to claim 9 wherein the pixel intensity values of the first 
and/or the second images are modified prior to or during the replacing step. 

11. A method according to any one of claims 1 to 10 further including one or 
more data compression steps. 

12. A method according to claim 11 wherein data compression results in 
selective modification of the relative intensity values of pixels. 

DATED: 24 February. 1 998 
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A method of processing digital image infomiation, including pixel intensity 
.0 ormauon. includes the steps of identitying a region of the image in which p«el 
.ntens,t,es are similar to each other, bu, the median pixel intensity differs 
s.gn,f,oamiy from the median pixel intensity of other parts of the image; and 
mod,fy,ng p,xel intensities in the idenuned region so that the median for the region 
is closer to the median for the other parts of the Image. 

n^ J """"^ °' '•"'^9^ '"fo""^"''" involves 

n>od,fy,ng p„e. intensities according ,o a non-Hnear algonthm. ,^th the result that 

one or more regions of tf.e image have their median pixel intensities adjusted to a 
level v,h,ch is closer to the median pixel intensity for other parts of the image 

"■"""'"^ <«9«a' '-age can be fom,ed by obtaining first and second 

he ..her, ,<,ent,.>„„g „ ^^.^^^ ^ .^^^^ ^^^^ 

reg,ons of the f,,.t .mage with the corresponding regions of the second image 



-•*VINWORDMAftJ0IUE\STCISIOMltvnA)C 



fa 





R 


-/adc 


C 






B 


y AX 





t6bits 



I6bits 



16biu 



DSf 
I 



DSP FiltCT out user 
selectable range of 8 bhs 



SbitsR 




Y(4) 


y 

SbruC 
» 


DSP 


► 


SbiuB 


2 








► 



Figure 1 



DSP Convert RGB to 
YUV of ratio 4:2:2 



DSP 



50% 
dasj 



Storage 



DSP Compress data to 
ratio 2:1 




m 



4-bit grey scale (16 tones - blackMhite) 8-bi 
Figure 2 




bit grey scale (256 tones - black/white) 



6 



10 




Scene Z3 



Figure 3 



JCC.IM^i 



2 



No. of 
Pud 



Ntax 




Figure 4 



• • » 

• • • 

• • • 

• • • • 

• • • 

• * • 

• • • 

• • • 

• • • 

• • • 

• • • 

• • • • 

• • • 

• • • 

• • • • 



• • • 

• « • 

• • • • 

• • • 



• • • 

• • • • 

• • • • 



• • • • 

• • • • 

• • • 

• • • 

• • • 



Ymax 



20% range 
High intensity range 





I I I I I I I I 



Division (Scene_Dtv) 



10 



16 



1 0 levels Tor Scene 



6 levels for 
License Plate 



Level 



Figure 5 



10 



3 



I « t 

• f 
• t • 

• t • 

• t 



« 

• t 



• • • 




Scene License Plate Area 

Figure 6 



High Orxfer Diis 



MSB 7 



Oil l*0.6 are selected 
to represent the new 4* 
bit image. 



Low Order Bits 

















' 1 




LSB 



• 

« 5 -.. 4 \ I 



-a 


••A 




• 


I' 


4 


2 


t 



MSB 



LSB 



• • • 



Figure 7 



• « 

• • • 



For example, a pixel has an intensity v-aluc of 230. 
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Figure 14 ~ Example of "Plate Burn" or "Hot Plate' 
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